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The 1969 Virginia Needs Assessment project vas 
conducted in two stages: (1) identification of statewide school 
program goals, and evidences of programmatic effozrt nnd outcomes; and 
(2) the development of a model that focused on th^ lecirner in the 
school environment, and incorporated cognitive, affective, and 
facilitative data in the context of the student < 5 self system 
interacting with the social system. For the 1974 projectr it vas not 
necessary to redefine objectives or to redesign the strategies and 
instrumentation used to measure them* Instead, th^ goals for the 1974 
project were to update the status of learner outcomes by reassessing 
performance in a longitudinal sample, and to investigate the 
measurable relationships between student characteristics in the 
cognitive and affective domains* Besults and disc^ission of the 
findings are presented* (Author/BW) 
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In 1969 Virginia assumed full responsibility for administration of Title 
III, ESEA. At that time the Virginia State Department of Education, as part of 
the Title III, ESEA State Flan, initiated a program to assess the educational 
needs of public school children in the cognitive and affective domains and 
contracted with the University of Virginia to conduct this project. The model 
for this assessment in the cognitive and affective domains was presented at the 
1970 AERA meeting and the results were published in December, 1970. 

To complete its State Plan, the Virginia State Department of Education 
contracted with the Glen Haven Achievement Center in 1971 to conduct a needs 
assessment in the psychomotor domain. Thia s^udy was published in November, 
1973. 

In April, 1974, the Virginia St^t^ DepafiTw'sxent of Education contracted 
for a second phase of educational nee^is; ^ssec^sment with the University of 
Virginia in the cognitive-affective domains and with the Glen Haven Achievement 
Center in the psychomotor domain. The objective of this paper is to present the 
progress and evaluation of the cognitive-affective model from 1969 to 1975 and 
to report longitudinal growth in school childrenv The assessment of the psycho- 
motor domain by the Glen Haven Achievement Center will not be dealt with in this 
paper. 

Procedures 

The 1969 Needs Assessment project was conducted in two stages. The first 
stage was to identify statewide school program goals, evidenc^ps of programmatic 
effort, and evidences of programmatic outcomes. This stage proceeded, from pro- 
ject objectives through the documentary analysis of policy guidelines, program 
recommendations, and programmatic directives. The second stage of the project 
concentrated on the development of a model that focused on the learner in the 
school environment, and incorporated cognitive, affective, and facilitative 
data in the context of the student's self system interacting with the social 
system. The purpose of this research strategy was to identify and describe the 



status of learner needs In terms of their Incidence, crltlcallty, and dispersion » 
and their relationship to self and social variables. 

Specific behavioral objectives In the learner-oriented (cognitive ar«d 
affective)' domain were based on, and developed from, three sources of goals: 
internal authoritative policies, Internal non-authorltatlve recommendations, 
and external non-authorltatlve recommendations. In addition, evidence of 
programmatic effort such as officially-accepted curriculum guides and accredi- 
tation standards were used to specify behavioral objectives. Objectives were 
developed In English (literature, language, and composition), mathematics, 
reading, science, social studies, as well as personal and social categories of 
affective behavior. Additional behavioral objectives were developed for seven 
other curricular areas, and objectives In the supportlve-facllltatlve domain 
were developed for school system personnel and Instructional resources (parti- 
cularly library and audio-visual facilities) • 

Needs were generally and operationally defined as absolute or relative 
gaps between goals and evidences of programmatic outcomes. An absolute gap 
occurred when goals sought outside of Virginia were not programmatlcally imple- 
mented in the state. A relative gap occurred when goals were in varying degrees 
programmatlcally implemented in Virginia, but evidence of programmatic outcomes 
fell short of established standards. 

This first (1969) project had to Identify, define, and document school 
program objectives which could be assessed in relation to the level and nature 
of program effort, and in relation to student behaviors measurable in the 
cognitive and affective domains within the context of the self-social instruc- 
tional system. The major products of the 1969 project were the specification 
of objectives, the development of appropriate instrumentation to measure status 
with respect to these objectives, and the establishment of baseline levels of 
program outcomes in term^ of student performance.^ 

For the 1974 project, it was not necessary to redefine objectives or to 
redesign the strategies and insfriimentatlon used to measure them. Instead, the 
goals for the 1974 project were to update the status of learner outcomes by 
reassessing performance In a longitudinal sample, and to investigate the 
measurable relationships between student characteristics in the cognitive and 
affective domains. 

In the 1969 project, behavioral objectives in the affective domain had 
been used to develop an affective assessment instrument which documented student 
self-concept, attitudes toward the school and its tasks, attitudes tovard citizen- 
ship, and attitudes with respect to the student's relations with others in the 
social context. The strategy of the 1974 project was to readminister to a 
sample composed of longitudinal or follow-up students relocated from the 196^ 
project and to a new sample of students in the lower grades both the affective 
instrumentation and cognitive performance tests in reading comprehension and 
writing. Through Fall and Spring administration of these instniments to these 
students, coupled with the assembly of appropriate standardized test scores 
available on the students in other subject-matter areas, two goals could be 
met: the assessment and analysis of student outcomes in the subject-matter areas 
from 1969 to 1974, and the analysis of the interrelation of student cognitive 
and affective characteristics. In meeting this latter goal, the validity of 
affective assessment to provide information which could be used as a basis for 
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selected In each of the grades* 7 "^and 11. In 1975, two samples were used, 
first consisted of those students who were In grades 4 and 7 In the 1969 
le and who now are In grades 9 and 12. (Approximately 4100 9th graders 
3300 12th graders were successfully followed.) The second sample consisted 
stratified random sample of appro:clmately 8000 4th graders and 8000 6th 
ers. A breakdown of both samples Is. shown on Table I. 

Fifty-seven school divisions had participated In the 1969-70 Needs 
ssment, selected to represent the state's school divisions In size, pop- 
Lon density, geographical location, and program features. The resulting 
Le was found to be representative of the state and of the six regions Into 
1 It was divided: Southwest Virginia, Valley of Virginia, Northern 
Lnla, Central Virginia, Southslde Virginia, and Tldewatar Virginia. For the 
-75 testing, fifty-six of these original districts participated. Three new 
ricts were added to fill out representation in all twenty-two Virginia 
ling districts. 

tmzntatCon and Anaty^la 

Data collected in the 1974-75 Needs Assessment Project will provide 
rmation useful in assessing educational needs in Virginia along the follow- 
llmenslons : 

a) Reading comprehension in subject content areas of social 
studies, language arts, science, and math, and the relation- 
ship of interest in the material to comprehension. 

b) Pupil self-concept related to the school environment, and the 
relation of affect to educational performance on standardized 
tests and on reading comprehension and composition skills. 

c) Development of composition skills Including sentence structure, 
punctuation, syntactical construction, and spelling. 

Instruments were administered at all four grade levels in these three 
! in both the fall and spring testing programs. Answer sheets for all 
! except the composition exercise were designed to be machine-readable. 

The difference between the instrumentation for Phase I and Phase II 
sted of the addition of a writing sample and the reading comprehension in 
ontent area. Further, the affective instrument developed in Phase I was 
ed and normed on the Phase II sample. (See Table II for Data Collection 
uments for Phase I and Phase II). Instrumentation and analysis in the 
areas under study is described below. 

eading comprehension - Tests were prepared by selecting stories from a 
known series of reading exercises covering the content areas of social 
es, language arts, and science. Several tests in the math content area 
also added at the sixth grade level. Four forms of the test were prepared 



TABLE I 
SAMPLE_£IZE BY GRADE 

Cognitive and Affective Domains 

Phase I (1969) 



Sample 


Grade 4 


Grade 7 


Grade 11 


Total 


Schools 


207 


151 


138 


296 


Class Sections 


208 


283 


239 


730 


Students 


7,000 


7,075 


5,975 


20,050 



Phase II (1974) 



Sample 


Grade. 4 


Grade 6 


Grade 9* 


Grade 12* 


Total 


Schools 


169 


143 


125 


100 . 


537 


Class Sections 


279 


281 






560 


Students 


7,043 


7,464 


4,142 


3,323 


21,972 



* All students at this grade level participated In Phase I. 
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for fall testing, one for each grade level, with pupils in each grade as! ed 
to read three or four ''core" stories (identical for all pupils taking that 
test form) and one or two "additional" stories. There were from 30 to 50 
additional stories at each level. Administration of the tes^ts was untimed; 
pupils were asked to read each story and answer multiple choice questions 
about its content. They were also asked to indicate thair interest and rate 
the difficulty of each story and its questions. 

An analysis of reading comprehension results was mailed to Division 
Superintendents in late April. Graphs were drawn by computer depicting, for 
each grade tested, division performance related to regional and state mean 
scores in each of the content areas studied. 

These reading comprehension tests were readminlstered in the spring 
testing. Howuver, half of the twelfth grade pupils were randomly assigned the 
ninth grade test forms, and half of the ninth grade pupils were given the 
twelfth grade tests. Similarly, half of the sample class sections at grade 
four in each division completed sixth grade reading comprehension tests, with 
half the sixth grade sections taking the fourth grade form. This distribution 
of test forms enables comparisons across grade levels of the spring test 
results, while providing for comparisons with fall results at each grade level. 

2. Affective Assessment * These questionnaires represented revisions of 
affective instruments used in the 1969-70 Needs Assessment. Three forms of the 
questionnaire have been developed, with fourth and sixth grade pupils completing 
the elementary form, and ninth and twelfth grade pupils taking the intermediate 
and secondary forms, respectively, in both fall and spring testing. 

Analysis of the questionnaire includes computation of score's for four 
subscales and the total questionnaire. These scales parallel the categories of 
affective objectives on which design of the questionnaire was based. They are 
identified as follows: 

1. Citizenship — Items in this scale measure citizenship in terms 
of both understanding of and support for societal structures and 
acceptance of and concern for other people. 

2. School, Education md Learning Compatability with the school 

envxronment is assessed in terms of behavior in tht classroom and 
attituces toward school work. Questionnaire items contributing to 
this scale measure a student's interest and inquisltiveness in 
learning and care in completing school work. 

3. Interpersonal relations — Items grouped in this seals deal with how 
an individual relates to his teachers and peers in the classroom. 

In particular, group orientation and conformity to group norms are 
assessed. 

4. Self-Esteem — The statements in this scale require an individual 
to assess his own feelings and performance. T^lle items aru phrased 
in terms of the school environment, they seem to represent more 
generally his feelings about himself and his capacity to cope. 
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ground clearly defined) as stimulus. The data In the pupil compositions Is 
approximately 20 times as extensive as that analyzed In the National Assess- 
ment of Education Progress writing study* 

VdtoL .CoZZdCJtlon 

Data collection for Phase I was Initiated In the fall of 1969. Contact 
was made through the State Department of Education and workshops were conducted 
to familiarize school division representative? with the program and its require- 
ments. All testing was handled by the contractor who also scored and analyzed 
all test results. 

For Phase II of the Teeds Assessment tests were administered in the fifty- 
nine participating divisions in Fall, 1974r Follow-up testing of all sample 
pupils was completed in the Spring, 1975 term.* Prior to testing, workshops were 
conducted by Needs Assessment personnel in six locations throughout the state 
to explain test administration procedures and allow school division represen- 
tatives the opportunity to pose questions and discuss the testing. Most divisions 
attended both the Fall and Spring workshops; testing materials for divisions 
which failed to attend were mailed and telephone contact was made to assure 
proper administration. Completed tests were returned to the Department of 
Research Methodology of the University of Virginia by mall (See appendix A for 
schedule of Phase II testing program). 

Results and Interpretations 

COQYUtLviL Vomdui 

In Phase I of the assessment in the cognitive domain, comparisons of the six 
geographical regions were made on the basis of the statewide totals, which were 
compared with national norms. Regionally, mean levels of verbal I.Q. were high- 
est Iji Region 2 and lowest in the Region 3 and Region 3 areas. Region 3 and 
Region 5 fi*ll below statewide totals decisively in all the cognitive areas. The 
defined low abilities in the Region 3 and Regicn 5 areas have added significance 
in the context of low cognitive means in these two regions, as do the defined 
high abilities in Region. 2 in the context of high cognitive means in this region. 

Cognitive Achievement and Needs: G^ade 4 The SRA Achievement Series ^ 

Blue Level was used to determine cognitive performance. Because this battery was 
administered in March 1970 (a time for which there are no set national norms), 
the staff adjusted the national norms to correspond to a grade equivalency of 
4.7. 

Rank order of regions determined by the number of cognitive clusters at or 
f?'ove the national means was as follows: Region 2,12; Region 4 and Region 6, 
10; Region 1,7; Region 5,1; and Region 3,0. 
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Figure 1 

Model for the Assessment of Needs in the 
Affective Domain* 
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Cognitive Achievement and Keeds: Grade 7 The grade 7 sample Intelli- 
gence quotients v^re assessed by the Callfom.lr's Short-Fort Test of Mental 
Maturity ♦ 

Regionally mean levels of language I.Q., non-language I.Q., and total 
I.Q. were highest' In Region 2. Region 1 ranked lowest In non-language I,Q. and 
total I.Q., while Region 4 ranked lowest In language I,Q. The scores for the 
language and total I.Q.'s for Reglour-iv 4 and 5 were seriously below the state- 
wide mean. On the other hand. Region 2 and Region 6 had considerably higher scores 
than the statewide mean, which Indicates an unbalanced situation with regard to 
measured I.Q.'s existent In Virginia. 

Regionally 12 cognitive areas were asressed. Regions 2 and 6 showed nc 
needs. (Excellence was achieved In all 12 cognitive clusters based on the state- 
wide mean. However, In grade 7, no region had a mean at or above the national 
norm in social studies, references, and charts. This has been a significant 
indicator for Virginia educators.) Regions 1, 4 and 5 fall below the established 
norms in all 12 cluster areas. 

Cognitive Achievement and Needs: Grade 11 The intelligence or aptitude 

of the grade 11 sample was assessed by the School and Colle?>e Ability Test . 
Regionally, the mean level of the verbal score was highest in Region 2 and fell 
below the national mean by only one point in Regions 1 and 6. Quantitative and 
total score means in all regions were equal to* or greater than the national 
norms, but were considerably higher in Region 2. 

Region 1 was lower than the state averages in all three subtests. Region 
6 lower In verbal and total scores, and Region 3 lower in verbal. Both Regions 
2 and 5 were higher in all three subtests. 

Rank orders of regions determined by the number of cognitive^ clusters at 
or above the national means was as follows: Region 2, 5; Region 6, Region 3 and 
5, 4 each; and Regions 4 and 1, 3 each. 

Reporting by cognitive cluster, all six regions had means at or above the 
national norm in social studies, reading, and writing; Region 6 alone fell be- 
low the national norm In listening; Region 2 alone ranked above tbe national 
mean in science; and all six regions fell below the national mean In mathematics. 

In Phase II of the assessment of the cognitive domain, the emphasis of the 
study was redirected based on Phase I results. As the primary dificits had 
been observed in the reading area, this study concentrated on reading in the 
subject content area. As was seen in Table II, the McCall-Crabbs Reading in the 
Content Area was administered to grades 4,6,9 and 12. These tests were designed 
to measure reading achievement in the subject content areas of language arts, 
science, and social studies in all four grades, with the addition of math at the 
sixth grade levels. Mean percent correct response scores in each of these content 
areas are presented for the six regions and the state as a whole by grade level 
in Table III, while comparisons of mean scores can be made within a grade level, 
comparison of scores across grades should consider trends rather than actual 
scores since different test forms were administered. 

These regional norms provide a benchmark indication of levels of performance 
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across the state* It should be pointed out chat the comparisons do not reflect 
differences Iti the quality of instruction; there may be differences In the 
levels of academic aptitude which school divisions In the various regions must 
work with. 

Pupils In Regions 2 and 6 scored consistently above the state averages In 
every content area In the four grades tested, ^^hlle average reading achleve- 
nent scores In these two regions were'very similar for grades 4 and 6, at cue 
ninth imd tweltth grade levels Region 2 pupils' average scores In all three 
content areas were considerably above those for all other pupils In Virginia. 
Average reading achievement scores for sample pupils In grades 4, 6, 9 nnd 12 
In Regions 3 and 5 were below state averages In all subject content areas. 
Their scor^.s were also below those of all other regions, with only one 
exception. At each grade level, reading achievement of pupils In Region 1 
paralleled the averages for the statewide sample. This was also true of mean 
scores for Region 4 students, with the exception of the ninth grade pupils 
whose average scores were above state averages In language arts, science, and 
social studies. 

A^itctivz VomcUn 

In the 1969-70 project, operationally-stated objectives were developed 
for these four areas based on a self-social system model. The model limited 
concern to those behaviors observable in the school and classroom setting. 

Based on these objectives, questionnaires for elementary. Intermediate 
and secondary grade levels were developed for use by classroom teachers. Items 
were formatted as statements, and students were given a five-point scale to 
indicate the degree to wMch each statement was true for them. Items were sub- 
jected to readability analysis and revision. After this, a pilot test was 
made on a diverse group of students, and item analysis and student comments 
were used to further revise the form. 

After revision a second pilot test of a diverse groip of students was 
conducted and revisions were made* These developmental e.Jforts provided forms 
which were easy to administer with items which were not offensive to laymen. 
During statewide administration of the form, np complaints were received about 
the content of the items from parents or community members. To check validity, 
the scales were related to other independent measures of personality such as 
achievement, classroom observation, and the sub-scales of t\. High School 
Personality Questionnaire. 

Large scale data-collection using the forms was cc .Jucted in 1970, . 
enabling the study of relationships with other measures. Next, pilot projects 
based on experimental teaching and videotaped classroom interactions were 
developed which used these scales to measure student affect. Data from three 
years of experimentation In these projects were used to again modify the 
scales. 

Through the 1974-75 testing, the questionnaire has been further validated 
by studying the scores in relation to student learning. The basis of this 
validation effort is that affective assessment for education should be conducted 
so that those attitudinal characteristics related to student learning are 
given attention. Strong correlations were found between the subscale scores and 
gains in student achievement. 
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The 1974-75 administration of the VAAQ In the Needs Assessment testing 
has provided data which establishes norms for the InstruTrent across the state 
and for regions within the state. Local school divisions will be able to 
administer the VAAQ to determine system-wide, school, or classroom needs in 
the affective domain, and the instrument can be u^ed as a flagging device to 
indicate a need for more comprehensive diagnosis in specific students. Since 
the VAAQ scoring system uses the association between the VAAQ scores and 
academic performance, the instrument can be used as an indicator of expected 
levels of student achievement associated with attltudlnal factors. As an 
assessment device, the scores obtained on the VAAQ may help to identify affec- 
tive deficiencies which may account for deficiencies or unsatisfactory progress 
in student achievement. 

Profiles for the six geographical regions were constructed for the four 
parts scores and total score on the Virginia Affective Assessment Questionnai re. 
The resultant was similar to the profiles developed for the cognitive domain. 
. A correlational analysis was then conducted for grades 6, 9 and 12. A summary 
of the results are Included in Tables IV, V and VI. 

As can be seen in Table IV, neither citizenship nor Interpersonal relation- 
ships relate to the cognitive domain at grade 6. Yet self to school, education 
and learning and self-esteem are highly related along with the total VAAO score. 
As can be seen on Table V, Interpersonal relationships still do not relate to 
the cognitive domain at grade 9, but by grade 12 (Table VI) all four part 
scores and the total score are highly related to the cognitive domain. 

Compo^AjbLon 

In Phase I of the Needs Assessment, deficits In the writing area were not 
explored. However, Phase II undertook the investigation of writing variables 
and their correlates to the affective domain and the cognitive domain. Table VII 
reports descriptive statistics on selected composition variables for grade 12. 
The results are wholly conslstant with those found in the reading portion of the 
study and the affective portion of the study. Total words written is generally 
higher for those regions with better cognitive ability and higher affective 
modal responses. The Inverse is true for number of words mlspelled and unique 
words mlspelled. That is, those regions with better cognitive abilities and 
higher affective modal responses tend to spell fewer words Incorrectly. 

When the composition variables are partitioned into high, middle and low 
attitudes groups, it is evident that affect has a direct relationship to these 
variables. As seen in Table VIII, there are very few reversals of this trend 
when the regions are looked at individually. This is further substantiated by 
examining the correlational analysis between the composition variables and the 
VAAQ part scores seen in Table IX. 

Summary 

The follow-on data collected in the Phase II study has provided longi- 
tudinal data to supplement the data collected in Phase I. The addition of 
reading and writing exercises has filled gaps evident in the final analyses 
of Phase I. Finally, the Virginia Affective Assessment Questionnaire and the 
Virginia Psychomotor Screening Instrument have been fully standardized and 
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nonned so that they can be made available to other educational agencies across 
the country. 

Follo]W-on action is being concluded this spring at the University of 
Virginia to correlate data collected in all three (3) domains: cognitive, 
affective and psychomotor which was not dealt with in this paper. This is 
being done to determine the effect of a deficit in any one domain as an 
indicator of potential problem areas in the other domains. Early results 
indicate high correlation will be found. This final report will be available 
for distribution during the summer of 1976. 
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TABLE VIII 



Composition Exercise 
Grade 12 - Fall. 1974 

Means of Writing Variables by Attitude Group 



Total words Written 

Region 1 
Region. 2 
Region 3 
Region 4 . 
Region 5 
.Region 6 

Total Virginia 

Percentage Total Words 
Mispelled 



Region 
Region 
Region 
Region 
Region 
Region 



Total Virginia ' 

Percentage Unique Words 
Mispelled 



Region 
Region 
Region 
Region 
Region 
Region 



Total Virginia 



Attitude Group 




High 


Middle • 


Low 


Total 


228. 08 


210. 84 


210. 26 


215.76 


235.96 


220.94 


184.02 


219. 97 


234.48 


238.10 


218. 45 


229. 04 


250. 35 


236.76 


206. 86 


2o2« 4z 


215. 06 


219. 65 


204. 56 


212 « 9 1 


246. 57 


232.90 


211.68 




235. 80 


225.63 


208. 21 




1. 56 


1. 74 


- 

1. 98 


1.77 


|1.67 


2. 24 


2. 39 


2« 01 


1. 8S 


1.97 


2. 35 


2« 09 


1.97 


2. 34 


2. 57 


2. 29 


1.79 


1. 79 


2. 12 


1. 51 


1.55 


1. 72 


2.10 


1« 76 


1. 70 


1.95 


2. 22 


1. 95 


2.43 


2. 75 


• 

3.16 


2.80 


2.68 


3.38 


3.62 


3. 11 


2^81 


3. 14 


3.57 


3.23 


2.98 


3. 58 


4. 11 


3.55 


2.61 


2. 76 


3.27 


2.91 


2. 31 


2.55 


3.33 


2.68 


2.60 


3. 00 


3.46 


3.02 
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Meeds Assessment Testing Procraro 
Spring, 1974 



Appendix A 



Summer, 1974 
September 3, 1974 

October 25, 1974 
November 6-7, 1974 

November 7-29, 1974 

November 29, 1974 
December 16, 1974 



December 1, 1974 
to 

January 15, 1975 



January 22, 1975 

February 15, 1975 
April 21, 1975 
April 23, 1975 

April 28-29, 1975 

April 29-May 1, 1975 

May 24, 1975 

May 21, 1975 

May 21-Junc 10, 1975 



Reading tests, writing tests and VAAQ selected, 
modified and developed* 

F0II0W--UP pupils. 4000 9th and 4000 12th graders 
Identified from 1969 Needs Assessment and all of 
their 1973 test data punched. 

School divisions Informed of program and asked to 
cooperate In locating schools and grades of follow-up 
pupils who had been Identified by searching 1973 
state test data. 

Fall workshops announced to divisions. 

Workshops conducted In six locations; fall testing 
materials distributed. 

Administration of fall tests to Needs Assessment 
sample pupils. ^ 

Requested completion date for testing* 

Cooperation of Prince William In giving fall tests 
assured as replacement for Fairfax lii 4th and 6th 
grades. 

Completed tests returned to Department of Research 

Methodology by all divisions except Prince William 
which had a late start. 

Testing packets mailed to principals of each Prince 
William school in which testing to be conducted. 

Completed Prince William materials returned. 

Spring workshops announced to division. 

Completed analysis of fall reading comprehension 
te&ts mailed to divisions. 

Workshops conductedHLn six locations; spring testing 
materials distributed. 

Administration of spring tests to Needs Assessment 
sample pupils* 

Letter sent to divisions thanking then for partici- 
pating and giving a schedule for completing analysis 
of fall testB* 

Requested completion date for spring testing* 

Completed tests returned to Department of Research 
Methodology by all participating divisions* 



